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Description 

FIELD OF THE INVENTION 

[0001 ] This invention relates to the field of voice mes- 
saging. l\^ore particularly, this invention relates to the 
field of accessing specific infomiation within a portion of 
a voice message. 

BACKGROUND OF THE INVENTION 

[0002] A multimedia messaging system of the prior art 
is illustrated in FIG. 1. The multimedia messaging sys- 
tem 10 includes a PBX (Private Branch exchange) tel- 
ephone system 12, a messaging server 14, a LAN (Lo- 
cal Area Network) 16, and an Internet gateway 18. In- 
coming telephone lines 20 are coupled to the PBX tele- 
phone system 1 2. The PBX telephone system 1 2 is cou- 
pled to the messaging server 14. The messaging server 
1 4 is coupled to the LAN 1 6. The Internet gateway 1 8 Is 
coupled to the messaging server 1 4. 
[0003] The PBX telephone system 1 2 includes a PBX 
22 and first, second, and third telephones, 24, 26, and 
28. The first, second, and third telephones, 24, 26, and 
28, are coupled to the PBX 22. The PBX 22 is coupled 
to the messaging sender 14. The LAN 16 includes a file 
server 30, a printer 32, and first, second, and third com- 
puters, 34. 36, and 38. The LAN 1 6 couples the file serv- 
er 30, the printer 32, and the first, second, and third com- 
puters, 34, 36, and 38, together. 
[0004] It is well known in the art that the multimedia 
messaging system 10 can be configured with more or 
less telephones, computers, file servers, or printers. Al- 
so, it is well known in the art that the Internet gateway 
1 8 could be replaced by another type of network con- 
nection or could be eliminated altogether. 
[0005] The multimedia messaging system 1 0 manag- 
es multiple message fomnats Including voice messages, 
facsimile (fax) messages, text messages, and MIME 
(Multipurpose Internet Mail Extension) messages in- 
cluding one or more binary components. 
[0006] A voice message enters the multimedia mes- 
saging system 10 via one of the telephone lines 20, via 
the first, second, or third telephones, 24, 26, or 28, via 
the Internet gateway 18, orvia a microphone coupled to 
the first, second, or third computer, 34, 36, or 38. The 
voice message is stored on the messaging server 14. 
[0007] A voice message recipient retrieves the voice 
message by accessing the messaging server 14 via an 
external telephone, via the first, second, or third tele- 
phone, 24, 26, or 28, or via the first, second, or third 
computers, 34, 36, or 38. When accessing the messag- 
ing server 14 via the external telephone or via the first, 
second, or third telephone, 24, 26, or 28, the voice mes- 
sage recipient retrieves the voice message using a tel- 
ephone user interface. The telephone user interface 
provides access to the voice message via touch-tone 
telephone keys and a voice prompted menu system. 



2 

When accessing the voice mail message using the first, 
second, or third computers, 34, 36, or 38, the voice mes- 
sage recipient uses a voice playback/record GUI 
(Graphical User Interface) of the prior art and listens to 
. s the voice message via a speaker coupled to the first, 
second, or third computer, 34, 36, or 38. 
[0008] The voice playback/record GUI of the prior art 
is illustrated in FIG. 2. The voice playback/record GUI 
40 Includes a title bar 42, a drop-down menu bar 44, a 

10 message status window 46, a progress display bar 48, 
a message control bar 50, a volume control 52, and a 
speed control 54. It is well known in the art that GUIs in 
general can be arranged in a multitude of fonnats and 
styles, so the voice playback/record GUI 40 should be 

15 understood to be an example format and an example 
style selected from the multitude of formats and styles. 
[0009] The title bar 42 of the voice playback/record 
GUI 40 indicates a software title, whteh In this case Is 
"Voice Message Software," a generic title. The drop- 

20 down menu bar 44 Includes the headings of "File," "Au- 
dio," "Recent," "Options," and "Help." The message sta- 
tus window 46 indicates whether the voice message is 
In "Play" mode. "Pause" mode, or "Record" mode. The 
message status window 46 also indicates a current lo- 

25 cation within the message. In FIG. 2, the voice message 
is in the "Pause" mode and the current locations is indi- 
cated as "0 kb" and "00:00." The latter indicates "00" 
minutes and "00" seconds. 

[0010] The progress display bar 48 includes a 
30 progress display indicator 56. a move backward button 
58, and a move forward button 60, As the voice mes- 
sage is being played, the progress display indicator 56 
moves across the progress display bar 48 from left to 
right. The move backward and move forward buttons, 
35 58 and 60. are used to move backward or fonward within 
the voice message. The message control bar 50 in- 
cludes a go-to-beginning icon 62, a skip back icon 64. 
a stop icon 66, a play icon 68, a skip fonward icon 70, a 
go-to-end icon 72, a record icon 74, and an erase icon 
40 76, all of which are clickable icons used to facilitate con- 
trol of the voice message. 

[0011] Faced with the problem of finding a specific 
piece of infomiation within a voice message, such as an 
address, a telephone number, or a day and time, the 

45 voice message recipient will either listen from the begin- 
ning of the message until the voice message recipient 
hears the specific piece of infonnation or the voice mes- 
sage recipient will use the skip fonward icon 70 or skip 
back icon 64 to try to locate the specific piece of Infor- 

50 mation. 

[0012] It would be advantageous to be able to find a 
specific piece of Information within a voice message 
more efficiently. 

[0013] What is needed is a method of efficiently find- 
55 ing a specific piece of infonnation within a voice mes- 
sage. 



EP 1 102 461 A2 



2 



3 



EP1 102 461 A2 



4 



SUMMARY OF THE INVENTION 

[0014] The present Invention is a method of book- 
marlcing a voice message including the step of marking 
the voice message with a bookmark in a bookmark lo- s 
cation. The present invention also includes a method of 
accessing the voice message at the bookmark location 
by selecting the bookmark. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] FIG. 1 illustrates a multimedia messaging sys- 
tem of the prior art. 

[001 6] FIG. 2 Illustrates a voice playback/record GUI 
(Graphical User Interface) of the prior art. . 
[0017] FIG. 3 illustrates the prefen^ed bookmarking 
method of the present invention. 
[0018] FIG. 4 illustrates the preferred bookmark ac- 
cessing method of the present invention. 
[0019] FIG. 5 illustrates the preferred apparatus for 
bookmarking the voice message of the present inven- 
tion. 

[0020] FIG. 6 illustrates a voice playback/record GUI 

of the present invention. 

[0021] FIG. 7 illustrates an alternative bookmarking 
method of the present invention. 
[0022] FIG. 8 illustrates a first alternative voice play- 
back/record GUI of the present invention. 
[0023] FIG. 9 illustrates a second alternative voice 
playback/record GUI of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

[0024] The preferred bookmarking method of the 
present invention is illustrated in FIG. 3. The preferred 
bookmarking method 80 includes first, second, and third 
steps, 82, 84, and 86. tn the first step 82, a voice mes- 
sage author begins recording the voice message. In the 
second step 84, the voice message author marks the 
voice message with a first bookmark, using a user inter- 
face, while continuing to record the voice message. In 
the third step 86, the voice message author marks the 
voice message with additional bookmarks while contin- 
uing to record of the voice message. It will be readily 
apparent to one skilled in the art that the voice message 
author can pause the recording while marking the voice 
message with the first bookmark and the additional 
bookmarks. It will also be readily apparent to one skilled 
in the art that the preferred bookmarking method 80 
does not necessarily include the third step 86 so that the 
voice message is not marked with the additional book- 
marks. 

[0025] The preferred bookmark accessing method of 
the present Invention is illustrated In FIG. 4. The pre- 
ferred bookmark accessing method 90 includes fourth, 
fifth, sixth, and seventh steps, 92, 94, 96, and 98. In the 
fourth step 92. a listener, such as a voice message re- 



cipient, selects the bookmarked voice message. In the 
fifth step 94. the listener Indexes to the bookmark within 
the voice message using the user interface. In the sixth 
step 96, playback begins at the bookmark and the lis- 
tener listens to the bookmarked voice message begin- 
ning at the bookmark. Upon the listener selecting the 
bookmark in the fifth step 94. a player automatically po- 
sitions playback at the bookmark and begins to play con- 
tinuously so that the listener listens in the sixth step 96 
until the playback is interrupted by the listener or until a 
voice message end Is reached. In the seventh step 98, 
the listener listens to more of the bookmarked voice 
message by selecting the additional bookmarks. Alter- 
natively the preferred bookmark accessing method 90 
does not Include the seventh step 98 so that the listener 
does not access the additional bookmarks. 
[0026] A voice message apparatus of the present in- 
vention is Illustrated in FIG. 5. The voice message ap- 
paratus 100 includes a user interface 1 02, a processing 
unit 104, and a storage media 106. The user Interface 
1 02 Is coupled to the processing unit 1 04. The process- 
ing unit 104 is coupled to the storage media 106. The 
user interface 102 includes a mrcrophone and'a speak- 
er. Preferably, the voice message apparatus is a com- 
puter where the user interface 1 02 includes a voice play- 
back/record GUI (Graphical User Interface), where the 
processing unit 104 Is a computer processing unit, 
where the storage media 1 06 is a computer disk drive, 
and where the prefen-ed bookmarking method 80 (FIG. 
3) and the prefen-ed bookmark accessing method 90 
(FIG. 4) are implemented as computer software. Pref- 
erably, the computer Is arranged as part of a multimedia 
messaging system where the storage media 106 Is part 
of a messaging server Alternatively, the storage media 
is any type of magnetic, optical, or magneto-optical stor- 
age, and the computer is a stand-alone computer or the 
computer is part of a different type of network. 
[0027] The voice playback/record GUI of the present 
invention is illustrated in FIG. 6. the voice playback/ 
record GUI 110 includes a title bar 42, a drop-down 
menu bar 44, a message status window 46, a progress 
display bar 48, a message control bar 50, a volume con- 
trol 52, a speed control 54. The drop-down menu bar 44 
includes an add-bookmark function 1 1 2, which is depict- 
ed as "AddBookmark" in FIG. 6. It will be readily appar- 
ent to one skilled in the art that the add-bookmark func- 
tion 112 can be implemented in numerous fonnats. For 
example, the add-bookmark function could be depicted 
as a clickable icon and added to the message control 
bar 50. 

[0028] The progress display bar 48 includes first, sec- 
ond, third, and fourth bookmark indicators, 114, 116, 
118, and 120. To access the first, second, third, or fourth 
bookmarks, 114, 116, 118, or 120, the listener clicks the 
first, second, third, or fourth bookmarks, 114, 116, 118, 
or 1 20. It will be readily apparent to one skilled in the art 
that the first, second, third, and fourth bookmarks, 114, 
116,118, and 1 20, can be implemented In numerous f or- 
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[0029] First and second alternative bookmarking 
methods of the present invention account for a possible 
cognitive delay between a decision to place the first 
bookmark, or the additional bookmarks, and an actual 
placement of the first bookmark, or the additional book- 
marks. The first alternative bookmarking method of the 
present invention method adds a first additional step to 
the preferred bookmarking method 80. The first addi- 
tional step places the bookmark and the additional book- 
marks at utterance beginning locations. The utterance 
beginning locations are beginning of utterances. The ut- 
terance beginning locations are found using an intelli- 
gent search, The intelligent search preferably employs 
a voice processing technique. The voice processing 
technique is selected from a group including a voice pa- 
rameter, an amplitude, a plosive, a pitch change, a 
number recognition, and a word recognition. 
[0030] The second alternative bookmarking method 
of the present Invention adds a second additional step 
to the preferred bookmarking method 80. The second 
additional step places the bookmark and the additional 
bookmarks at locations that are a specific time duration 
before an actual selection of the bookmark and the ad- 
ditional bookmarks. It will be readily apparent to one 
skilled in the art that the specific time duration can be a 
user selected parameter. 

[0031] A third alternative bookmarking method of the 

present invention is illustrated in FIG. 7. The third alter- 
native bookmarking method 130 includes eighth, ninth, 
and tenth steps, 132, 134, and 136. In the eighth step 
132, a bookmarking person listens to a pre-recorded 
voice message. In the ninth step 134, the bookmarking 
person marks the pre-recorded voice message with the 
bookmark, while listening to the pre-recorded voice 
message using the user interface. In the tenth method 
step 136, the bookmarking person marks the pre-re- 
corded voice message with the additional bookmarks, 
while continuing to listen to the pre-recorded. The book- 
marking person can be the voice message author, the 
voice message recipient, or a person that Is not the voice 
message author or the voice message recipient but who 
has access to the voice message. 
[0032] A fourth altemative bookmarking method of the 
present invention adds a third additional step to the third 
altemative bookmarking method 130. In the third addi- 
tional step, the listener annotates the bookmark and the 
additional bookmark with a type of inf omiation. The type 
of infomriation Is selected from the group including text 
and icons. 

[0033] A first altemative voice playback/record GU i of 
the present Invention, which implements the fourth al- 
ternative bookmarking method, Is illustrated in FIG. 8. 
The first alternative voice playback/record GU1 1 40 adds 
an annotation window 142 to the voice playback/record 
GU1 110. The annotation window 142 Includes first, sec- 
ond, third, and fourth annotations, 144, 146, 148, and 
150, which con^espond to the first, second, third, and 
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fourth bookmarks, 114, 116, 11 8, and 120. The first, sec- 
ond, third, and fourth annotations, 144, 146, 148, and 
150, indicate sections of the voice message. It will be 
readily apparent to one skilled in the art that the fist, sec- 

s ond, third, and fourth bookmarks, 114, 116, 118, and 
120, and the first, second, third, and fourth annotations, 
1 44, 1 46, 1 48, and 1 50 can be numbered or lettered so 
that a correspondence between the bookmarks and the 
annotations is explicit. 

10 [0034] A second alternative voice playback/record 
GUI of the present Invention Is Illustrated In FIG. 9. The 
second alternative voice playback/record GUI 160 re- 
places the first, second, third, and fourth annotations, 
144, 146, 148, and 150, with first, second, third, and 

IS fourth detailed annotations, 164, 166, 168, and 170. The 
first, second, third, and fourth detailed annotations, 1 64, 
1 66, 1 68, and 1 70, add message specific infomnation to 
the first, second, third, and fourth annotations, 144, 146, 
148, and 150. 

20 [0035] A first altemative voice message apparatus is 
a telephone system and voice processing equipment 
coupled to the storage media 106. For the telephone 
system and the voice processing equipment, the user 
interface 102 is a telephone user interface (TUI), which 

25 includes touch tone keys and a voice prompted menu. 
The voice processing equipment Is that which is normal- 
ly associated with providing the TUI. The processing unit 
1 04 includes first electrical circuitry associated with the 
telephone system and the voice processing equipment. 

30 During playback of the voice message, the voice mes- 
sage recipient, upon hearing an important passage, 
presses a place bookmark touch tone key to set the first 
bookmark. The first bookmark is saved with the voice 
message so that the first bookmark is available in a sub- 

35 sequent playback of the voice message. This allows di- 
rect navigation to the Important passage using the TUI 
or the voice playback/record GUI. When using the TUI, 
the listener presses a go-to-bookmark touch tone key to 
commence playback at the first bookmark. It will be 

40 readily apparent to one skilled in the art that the voice 
message recipient can also place the additional book- 
marks using the TUI. 

[0036] A second altemative voice message appara- 
tus is an answering machine. For the answering ma- 

45 chine, the user interface 102 is a first mechanical user 
Interface, which includes first buttons/display on the an- 
swering machine. The processing unit 1 04 includes sec- 
ond electrical circuitry associated with the answering 
machine. The storage media 1 06 is an answering ma- 

50 chine storage media. Alternatively, the user interface 
102 for the answering machine is the TUI. 
[0037] A third altemative voice message apparatus is 
a recording machine. Forthe recording machine, the us- 
er Interface 1 02 is a second mechanical user interface, 

55 which includes second buttons/display on the recording 
machine. The processing unit 104 includes third electri- 
cal circuitry associated with the recording machine. The 
storage media 106 is a recording machine storage me- 
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[0038] An alternative user interface of the present in- 
vention is a voice connnnand user interface. 
[0039] An alternative eoibodinnent of the present in- 
vention automatically bookmarks the voice message us- 
ing automatic search and locate pattern matching In 
which specific voice message content is automatically 
bookmarked. The specific voice message content is se- 
lected from the group including phone numbers, e-mail 
addresses, physical addresses, dates, and times. 
[0040] It will be readily apparent to one skilled in the 
art that other various modifications may be made to the 
preferred embodiment without departing from the spirit 
and scope of the Invention as defined by the appended 
claims. 



Claims 

1. A method of bookmarking a voice message com- 
prising the step of marking the voice message in a 
first bookmark location with a first bookmark such 
that a listener accesses the vobe message at the 
first bookmark location by selecting the first book- 
mark. 

2. The method of claim 1 wherein the first bookmark 
location is selected by the listener. 

3. The method of claim 1 wherein the listener is a re- 
cipient. 

4. The method of claim 3 wherein the first bookmark 
location is selected by a person other than the re- 
cipient. 

5. The method of claim 4 wherein the person is an au- 
thor of the voice message. 

6. The method of claim 4 wherein the person Is an ed- 
itor of the voice message. 

7. The method of claim 3 wherein the first bookmark 
location is selected by the recipient. 

8. The method of claim 1 further comprising the step 
of marking the voice message in a second book- 
mark location with a second bookmark such that the 
listener accesses the voice message at the second 
bookmark location by selecting the second book- 
mark. 

9. The method of claim 8 wherein the listener is a re- 
cipient. 

10. The method of claim 9 wherein the first and second 
bookmark locations are selected by a person other 
than the recipient and further wherein the first and 



second bookmarks indteate sections of the voice 

message. 

11. The method of claim 8 further comprising the step 
s of marking the voice message at additional book- 
mark locations with additional bookmarks such that 
the listener accesses the voice message at the ad- 
ditional bookmarks by selecting the additional book- 
marks. 

10 

12. The method of claim 1 wherein the first bookmark 
location is selected during an utterance and further 
wherein the first bookmark location is moved to an 
utterance beginning location. 

15 

13. The method of claim 12 wherein the utterance be- 
ginning location is found using an intelligent search. 

14. The method of claim 13 wherein the intelligent 
20 search includes a voice processing technique. 

15. The method of claim 1 4 wherein the voice process- 
ing technique utilizes a voice parameter, the voice 
parameter being selected from the group consisting 

25 of an amplitude, a plosive, a pitch ch ange, a number 
recognition, a word recognition, and a combination 
thereof. 

16. The method of claim 1 wherein the first bookmark 
30 location is selected by a listener and further wherein 

the first bookmark location is moved backward In 
time by a specific time duration. 

17. The method of claim 1 wherein the first bookmark 
35 location is selected using a user interface. 

18. The method of claim 17 wherein the user interface 
is selected from the group consisting of a graphical 
user interface, a telephone user interface, a me- 

^0 chanical user interface, and a voice command user 
Interface. 

19. The method of claim 1 wherein the first bookmark 
location is accessed by a listener by selecting the 

45 first bookmark using a user interface. 

20. The method of claim 19 wherein the user interface 
is selected from the group consisting of a graphical 
user interface, a telephone user interface, a me- 

50 chanical user interface, and a voice command user 
interface. 

21. The method of claim 1 wherein the first bookmark 
location is selected automatically by a search and 

S5 locate pattern matching technique. 

22. An apparatus for bookmarking a voice message 
comprising: 
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a. a storage media for storing the voice mes- 
sage; 

b. a processing unit coupled to the storage me- 
dia; and 

c. a user interface coupled to the processing 

unit such that a user places a first bookmark at 
a first bookmark location within the voice mes- 
sage using the user interface. 

23. The apparatus of claim 22 wherein the user places 
a second bookmark at a second bookmark location 
within the voice message using the user Interface. 

24. The apparatus of claim 23 wherein the user places 
additional bookmarks at additional bookmark loca- 
tions within the voice message using the user inter- 
face. 

25. The apparatus of claim 22 wherein the first book- 
mark is selected during an utterance and further 
wherein the first bookmaric Is moved to an utterance 
beginning location. 

26. The apparatus of claim 25 wherein the utterance 
beginning location is found using a voice process- 
ing technique. 

27. The apparatus of claim 26 wherein the voice 
processing technique utilizes a voice parameter, 
the voice parameter being selected from the group 
consisting of an amplitude, a plosive, a pitch 
change, a number recognition, a word recognition, 
and a combination thereof. 

28. The apparatus of claim 22 wherein the first book- 
mari< location is moved backward In time by a spe- 
cific time duration. 

29. The apparatus of claim 22 wherein the user inter- 
face is selected from the group consisting of a 
graphical user interface, a telephone user interface, 
a mechanical user interface, and a voice command 
user interface. 

30. An apparatus for accessing a bookmarked voice 
message comprising: 

a. a storage media for storing the bookmarked 

voice message; 

b. a processing unit coupled to the storage me- 
dia; and 

c. a user interface coupled to the processing 
unit such that a listener accesses a first book- 
mark location within the bookmarked voice 
message by selecting a first bookmark using 
the user interface. 

31. The apparatus of claim 30 wherein the listener ac- 



cesses a second bookmari< location within the 
bookmarked voice message by selecting a second 
bookmark using the user interface. 

5 32. The apparatus of claim 31 wherein the listener ac- 
cesses additional bookmark locations within the 
bookmarked voice message by selecting additional 
bookmarks using the user interface. 

10 33. The apparatus of claim 30 wherein the user Inter- 
face Is selected from the group consisting of a 
graphical user interface, a telephone user interface, 
a mechanical user interface, and a voice command 
user interface. 

15 

34. An article of manufacture comprising a computer 
readable medium bearing computer program code 
embodied therein for use with a computer, the com- 
puter program code including means for marking 
20 the voice message in a first bookmark location with 
a first bookmark such that in operation a listener ac- 
cesses the voice message at the first bookmari< lo- 
cation by selecting the first bookmari<. 

25 35. Thearticleof manufacture of claim 34 further includ- 
ing means for mari<ing the voice message in a sec- 
ond bookmark location with a second bookmark 
such that in operation the listener accesses the 
voice message at the second bookmark location by 

30 selecting the second bookmark. 

36. The article of manufacture of claim 35 wherein In 
operation the first and second bookmark locations 
are selected by a person other than the listener and 

35 further wherein the first and second bookmarics in- 
dicate sections of the voice message. 

37. The article of manufacture of claim 34 wherein in 
operation the first bookmark location Is selected by 

40 a person other than the listener. 

38. The article of manufacture of claim 34 wherein in 
operation the first bookmark location is selected by 
the listener. 

45 

39. The article of manufacture of claim 34 wherein in 
operation the first bookmaric location is selected 
during an utterance and further wherein the first 
bookmark location is moved to an utterance begin- 

50 ning location. 

40. The article of manufacture of claim 39 wherein in 
operation the utterance beginning location is found 
using a voice processing technique. 

55 

41. The article of manufacture of claim 40 wherein in 

operation the voice processing technique utilizes a 
voice parameter, the voice parameter being seiect- 
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ed from the group consisting of an amplitude, a plo- 
sive, a pitch change, a number recognition, a word 
recognition, and a combination thereof. 

42. The article of manufacture of claim 34 wherein in 

, operation the first bookmark location Is selected by 
the listener and further wherein in operation the first 
bookmark location is moved backward in time by a 
specific time duration. 

43. The article of manufacture of claim 34 wherein In 
operation the first bookmark location is selected us- 
ing a user interface. 

44. The article of manufacture of claim 43 wherein the is 
user interface is selected from the group consisting 

of a graphical user interface, a telephone user in- 
terface, a mechanical user Interface, and a voice 
command user interface. 



45. The article of manufacture of claim 34 wherein in 
operation the first bookmark location is accessed 
by the listener by selecting the first bookmark using 
a user Interface. 
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46. The article of manufacture of claim 45 wherein the 
user interface Is selected from the group consisting 
of a graphical user Interface, a telephone user In- 
terface, a mechanical user Interface, and voice 
command user interface. 30 

47. The article of manufacture of claim 34 wherein in 
operation the first bookmark location Is selected au- 
tomatically by a search and locate pattern matching 
technique. 35 
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